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functions of nonequilibrium steady states. In particular, sum rules and asymptotic behaviors 
are derived, which relate many independent experiments. Their consequences are illustrated 
for nonlinear optical materials and nonlinear electrical conductors. 
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1^ ■ The most important way of characterizing a physical state is to see its responses to 

J5 I weak external perturbations. Such responses are generally represented by response functions. 

For equilibrium states, their linear (<I)(^)'^^) and nonlinear (higher-order) response functions 
'^ ■ 

^ ' ((|)(2)eq^ (j)(3)eq^ . . . -j j^g^yg extensively been studied, and many universal properties were discov- 

O ! 

CJ . ered.^"'^^ Regarding nonequilibrium states driven by a driving force F, in contrast, only limited 



facts are known about universal properties of their response functions <I>(")^ (n = 1, 2, • • • ), 
even for nonequilibrium steady states (NESSs) for which $("')^'s are most clearly defined 
because all macroscopic quantities take constant values (in the sense of eq. (1) below). 

By universal properties we mean properties that are measurable experimentally (i.e., not 



(^ ' formal) and are not limited to a specific class of systems. Unfortunately, neither the fluctuation 



theorem^ (although it can reproduce known results for <I)'")''*5^)) nor the Jarzynski equality, ^^ 
both of which are considered to hold even in nonequilibrium, can give such universal properties 
of ^y^>" (at leat at present). Furthermore, although many formal expressions were previously 
derived for cj)!")-^^^') such universal properties were not derived from them. 

Universal properties of ^'^^'^'^ tend to be lost in cj)(")-f^. For example, the fluctuation- 
dissipation relations (FDRs) and the reciprocal relations^' ^^ are violated in NESSs.*' ^^ Never- 
theless, it was shown in ref. 9 that several properties hold universally for the linear response 
functions of NESSs, <1>'^^ , if those for $(1)'^'? are appropriately generalized. A natural question 
is: Do nonlinear $("'-^'s also have universal properties? 

In this paper, we answer this question. It is shown that the sum rules and the asymptotic 
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behaviors hold universally if those for ^(^'"^> are appropriately generalized to n > 2. The 
results are of fundamental importance to both physics and applications. 

NESS - Suppose that a static driving force F, which can be strong, is applied to a 
target system (the macroscopic system of interest). We consider the case where F induces a 
NESS in the target system for a sufficiently long time, i.e., for [tm,iout], where tout — tin is 
macroscopically long. By a NESS we mean a state in which every macroscopic variable A 
takes a constant value {A)f in the sense that its expectation value at time t behaves as^-* 

{A)'p = {A)f + o{{A),,). (1) 

Here, (^)tp denotes a typical value of A, and o((A)tp) represents a (time-dependent) term 
which is negligibly small in the sense that o{{A)tp) /{A)tp — )■ as y — )■ oo, where V denotes 
the volume of the target system. When A is the total spin S, for example, {S)tp = 0{V) 
and {S)*p = {S)f + o{V). According to experiences, such NESSs appear in diverse physical 
systems. 

We assume that NESSs are stable against small perturbations because otherwise repro- 
ducibility of experiments would be lost. That is, after small perturbations are removed the 
target system returns to the same NESS as that before they were applied. NESSs of most 
systems, apart from few exceptions such as glass near a melting point, satisfy this assumption. 

Response functions of NESS - Suppose that weak and time-dependent probe fields 
flit), f2it),- • • , fmit) (= fit)) are applied, in addition to F, to the target system for t > to- 
Here, tin < to < t < tout- The number m of the probe fields is arbitrary, although the case of 
m = n is sufficient for studying $(") " most generally. 

We are interested in the response of the NESS to fit). Specifically, we focus on the 
response, 

AAit) ^ {A)%_,f - {A)f, (2) 

of a macroscopic dynamical variable A of the target system. Since we are considering a stable 

NESS, AAit) may be expanded in powers of / (not of F) as AAit) = A^^^^t) + A^^'^^t) H . 

The n-th order response can then be expressed phenomenologically as^'^*^'^^-* 

rn ft ft 

dt„$i7.:^„„(t - ti, • • • ,t - tn)faAtl) ■ ■ ■ fa^tn)- (3) 
to 



-, m rn ..t ,. 



As in the case of <|)("')°i,3) the n-th order response function $'")" of the NESS is defined by 
this and the causality relation, 

^ai---a„(Ti, • • • , Tn) = if either one of tj's < 0, (4) 
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and by the requirement (to remove arbitrariness) that <5Q,/...Q^(ri, • • • ,r„) is invariant under 
every permutation of aiTi, ■ ■ ■ ,anTn- As F ^ 0, <I)(")^ reduces to the n-th order response 
function <I)(")*''5 of equilibrium states }^^> 

Response to sinusoidal fields - In many experiments,^' ^'^•' the probe fields are taken as 
sinusoidal ones; 



fait) = /+e'*""* + /-e+*""* = Y. fae-'"''""', (5) 

a=±l 

where (/^)* = f^- Then, eq. (3) gives the n-th order response as 

A^W(t) = ^Y.---H ^^SaA'^lU^a,,--- ,'7nU^aJf^l---f^: e-('^l-'^i+-+— )*. (6) 






Here, H*-"-*^ is the Fourier transform of <1)("')^;12) 

/•+OD r+oo 

Sai-^a„(cria;„i, • • • ,anUJaJ = dn ■ ■ ■ dTn $i7.^a„(Ti, • • • , r„ ) 6* ^^ = ^ '^^' '^"i ^^ (7) 



When n = m = 2, for example, AA^'^'{t) includes terms such 
as (l/2)H[?^(a.i,c.i)(/+)%-2-i* + c.c, (1/2)h[?^(^i, -^i) |/+f + c.c. 



:(2)^A, ,, \f+f+^-i(uJi+uJ2)t , „^ "(2)i^ 



"12 



^1, W2)/i+/2^e-^('^i+'^2)t + c.c, E\y^ (wi, -t^2)/i^/2"e-^('^i-^2)t + ^.c, and so on. 



Microscopic expression of <I)(")^ - The equations so far presented are phenomenological 
ones which are closed in a macroscopic level. We now relate them to microscopic physics 
by deriving a microscopic expression of <!>(")", which will be used to derive new universal 
properties. In doing so, we do not employ perturbation expansion with respect to F^'^^ because 
such expansion converges only slowly or does not converge for large |-F| of interest,^' ^'^"^^ except 
in limited physical situations. 

To treat F non-perturbatively, we tentatively consider a huge system which includes the 
target system, a driving source that generates F, and their environments such as a heat 
reservoir(s), as shown in Fig. 1. We call this huge system the total system. One can always 
take it large enough so that it can be treated as a Hamiltonian system. Its Hamiltonian is 
denoted by H^°^, which consists of the Hamiltonians of individual systems and interactions 
among them. For i/*°*, one should use not toy models but a natural model which describes the 
real physical systems faithfully enough, such as the full Hamiltonian (consisting of electrons, 
nuclei and electromagnetic fields) for condensed matter. Starting from such a huge system, 
we will finally derive relations which contain quantities only of the target system. 

Regarding the probe fields / (= /i, /2, • ' ' )' ^^ treat them as external weak fields, which 
interact with the target system via the interaction term — Y2a=i ^afait)- Here, B^ is a macro- 
scopic dynamical variable (which is the sum of local variables; see ref. 13 and the later ex- 
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Fig. 1. An example of the 'total system.' It includes an electrical conductor (target system), a battery 
(source of the driving electric force F), air (heat reservoir), cables, and so on. 



amples) of the target system. Hence, the density operator of the total system p^p^fit) evolves 
as 



d 



^TfjFlfit) = (h'°' - j; B^Ut)) p'§Xf{t). 



(8) 



Q = l 



Here, 'x' denotes the commutator; a^b= [a,b]. 

We denote p^pXf{t) with / = by p^p^{t). When / = 0, the reduced density operator of 
the target system is 

pp^TT'[p'§\t)\, (9) 

where Tr' denotes the trace operation over the degrees of freedom other than those of the 
target system. As stated earlier, we consider the case where a NESS is realized in the target 
system (while the driving source is not in a steady state) for a macroscopic time interval 
[fin, tout]- In this interval, we can regard jip as being independent of t as far as macroscopic 
variables are concerned, a la eq. (1). Unlike the equilibrium case, however, an explicit form 
of pf is unknown. Nevertheless, we can later derive universal relations among experimentally 
measurable quantities. 

When / 7^ 0, p^p^{t) is changed into p^p\f{t)- For a macroscopic dynamical variable of 
interest, A, of the target system, we see its response IS.A{t) = Tr[/5^^j.(t)yl] — Tr[/5p*(to)A] = 
Tr[/55?^ J (t)yl] — Tr[pi?^]. Since we treat stable NESSs subject to weak f, we may evaluate 
AA(t) by evaluating the solution of eq. (8) using a power-series expansion with respect to / 
(taking p^p^{t) as the zeroth-order solution). We then obtain the n-th order response as 

m rn „t f* 1 

X Tr (p*/(f)f [KSin -tr--- B^,{ti - f)xi] ) U,{ti) ■ ■ ■ /,„(f„), (10) 



4/10 



J. Phys. Soc. Jpn. Letter 

where T is the chronological ordering operator, and the symbol ' " ' denotes an operator in the 
interaction picture, i.e., B[t) = e^ Be^" ' . l<rom consistency with the macroscopic 

physics, eq. (3), t of p^p^it) in eq. (10) must be irrelevant. Hence, we can take it to be an 
arbitrary time (such as to) in [iim^out], and simply write /5^*(t) as p^*. We thus obtain a 
general formula;^^' 



C;^.^a„(n, • • • ,r„) = ^Tr [pr \B^S-rnY ' ' ' B^,{-t^Y A\) (11) 

for Ti, • • • , r„ > 0. Here, Solt denotes the operator that symmetrizes the operand with respect 
to (XT [= am, ••• , anTr^, i.e., Soct!{<^\T\., ■■■ , UnTn) = {I / n\) Y^ p f {P {am , ••• , a„r„)), 
where P denotes permutation. Because of 5^,-, Tin eq. (10) becomes unnecessary in eq. (11). 

For classical systems, the commutators such as Ba^{—Ti)^ A/ih should be replaced with 
the corresponding Poisson brackets. 

The right-hand side (rhs) of eq. (11) represents some correlation in the NESS. However, 
even in the classical regime {kpT ^ fvjj), it is not equal to the time correlation of outcomes 
of experiments in general, as explained for n = 1 in ref. 9. Hence, cq. (11) is not the FDR. 
We therefore call it simply the n-th order response- correlation relation (nRCR). 

Simple relations - Several universal relations can be derived without using the nRCR. 
However, they are not so informative because they are nothing more than properties of Fourier 
transforms of real (causal) functions. [Hence, they hold equally for rS^'-i'^'^ and H*^"' .] For 
completeness, we present them before deriving new universal properties of H^"-* . 

By definition, Eai.--an{(TiOJai,' ' ' ,'^n^a„) is invariant under every permutation of 
aiaiojai,- ■ ■ ,ancrn^a„, where aj = 1,2,- ■ ■ ,m (j = 1,2, ••• ,n). It also has the following 
obvious symmetry; 

„(n)F , N _ „(n)F* , n /10^ 

'^ai---a„l>0'l'^ai) • ■ ■ > 0"ra'^a„ j — '='ai---Q!„ l," CTlWaj , • • • , — dnWc^j. (^iZj 

Hence, its real and imaginary parts are even and odd functions, respectively. Furthermore, 
from eqs. (4) and (7), one can derive the dispersion relations}^' For Wq,^, for example, 

vr 7_oo W - cticJqi 

(13) 

where V denotes the principal part. By taking the real and imaginary parts of this relation, one 

obtains relations between ReH'"-* and ImS'"-' . One can also derive moment sum rules^^' 

which are generalizations of those for H^^'*^'^.^' 

Sum rules and asymptotic behaviors of H^"'^ - Using the nRCR, we now derive universal 

properties^^^ which are very useful in physics and applications. Their physical meanings, 
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implications and typical examples will be discussed after presenting them all. 
The first property is the following sum rule for ReS'"'-^; 

which holds for all F as far as a stable NESS is realized, and, obviously, for all o"i, • • • ,o"„. 
Here, {■)f = Tr (pp ■ ) denotes the expectation value in the NESS of the target system, eq. (9). 
To derive this sum rule, we note that the left-hand side (Ihs) of eq. (14) equals the integral of 
•^^injF because ImH^"'-^ is an odd function. Hence, the Ihs equals <I>(^...q-„(-|-0, • • • , +0), which 
is evaluated from eq. (11) as the rhs of eq. (14). 

We also obtain the following sum rule for ImH^")-^; 



'=^dWj 
-oo ^ 



ajUJ 



3^3 



n r^ ImEtl'aAcriu:,, • • • ,.„a;„) - ^ (b^ ■ ■ ■ B^A 



yk (^j) 



vr / [in) 



i^T^)n\^^''r.■■■BaA0r■■■BJ^^A)^, (15) 

which holds for all F (as far as a stable NESS is realized) and all j (= 1, 2, • • • , n), and for 
all 0"!, • • • ,o"„. To obtain this relation for j = 1 for example, integrate eq. (7) by parts with 
respect to oJi, multiply the resulting equation with (JiOJi, integrate the resulting equation over 
a;2, • • • ,^n, and finally use eq. (11). 

From the above sum rules, we can also derive asymptotic behaviors of H^"^ as follows. 
Regarding Re H'"-* , it should decay quickly for large wi, ^2, • • • in such a way that the integral 
of eq. (14) converges because the rhs of eq. (14) is finite. Regarding ImH'"' , it should behave 
for large ojj (j = 1, 2, • • • , n) as 




(TjUj (ih) 



ImSLT^J^i^i,--- ,a„..„)-:r-7^(4^••4^i>. (16) 



for all F (as far as a stable NESS is realized) and all j (= 1, 2, • • • , n), and for all cJi, • • • , an, 
because the rhs of eq. (15) is finite. When the multiple commutator in the rhs of eq. (16) 
vanishes, ImH^"' decays more quickly. 

Physical meanings and implications - As discussed in ref. 9 for n = 1, the above sum 
rules should be considered as predictions not on cj)!")^ at Tj -^ +0 but on H*-""-*^ at many 
different frequencies (in a certain finite range, as discussed in ref. 9), because experiments are 
hard for the former and easy for the latter. 

The above sum rules and asymptotic behaviors contain quantities only of the target system 
(and its boundaries) , namely, A, Ba^ , • • • , Ba„ , Pf and Ba ■ (0) .^^-^ Since all of these operators 
except for pp are known operators, the nonequilibrium averages in these relations can easily 
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be measured experimentally. For example, to measure (B^ ■ ■ ■ B^A) , all one has to do 
is simply to measure B^ ■■■B^A (which often reduces to a simple operator, as will be 
illustrated later) in the NESS without applying f{t). One can also measure H^"'^ easily by 
measuring the responses by applying f{t) of various frequencies. Therefore, all terms in our 
universal relations can easily be measured experimentally. Furthermore, the relations give 
predictions on two or more independent experiments (e.g., one with f{t) and another without 
fit)). 

Let us examine a typical case where A is an lA-th. order polynomial of momentum (or 
position) variables whereas B^^s are Is-th. order polynomials of position (or momentum) 
variables. Then, B^ ■ ■ ■ B^^A is an [(Ib — 2)n + Z^]-th order polynomial. When Ib = 1, in 
particular, it becomes a lower-order polynomial for higher n, until it vanishes for n > Ia- 
Hence, we are led to a remarkable conclusion that if Ib = 1 the sum value of eq. (14) and the 
asymptotic value of eq. (16) become completely independent of F for n > Ia- 

For nonlinear optical susceptibilities, for example, Ia = Ib = ^ because A and B are 
proportional to the sums of positions and momenta of electrons, respectively. Hence, the sum 
and asymptotic values are independent of F for all n (> 1). 

Note that we have made almost no assumption except that the NESS is stable. Although 
the reduced (projected) dynamics of the target system may be described by non-Hamiltonian 
models such as dissipative stochastic models, one can always take the total system (such as 
Fig. 1) large enough so that it is well described as a Hamiltonian system. Our universal results 
have been derived from the Hamiltonian dynamics of such a huge system. [Nevertheless, they 
are relations among quantities only of the target system.] Therefore, our results should hold 
in diverse physical systems, including electrical conductors, optical materials, magnetic sub- 
stances, organic materials, and so on, even when they are subject to dissipative environments. 

Nonlinear electrical conductors - As an illustration, consider the case where the target 
system is a nonlinear electrical conductor of length L. Let e and m be electron's charge 
and mass, respectively, and qi and px be the x components of the position and momentum, 
respectively, of the jth electron in the conductor. We here consider the simplest case where 
both the static electric field F/e and the probe electric fields f{t) are applied along the 
conductor, in the x direction. Hence, B^ = Xli ^Qx (= B) for all /q,'s, and Ib = 1- 

If one is interested in the electric current averaged over the x direction, whose operator 
may be J = (e/rriL) ^ pi, then putting A = I yields B^A/{ih) = [e^Ne/mL)!. Here, iVg is 
the number of electrons in the conductor, and 1 is the identity operator. Hence, B^B^A = 0. 
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These are consistent with the above result on a typical case, where /yi = /^ = 1 in this example 
The sum rule, eq. (14), for the n-th order response function of A/(t) = {I)p;f — {I)f reads 

e^Ne/mL (n = 1), 



integral in eq. (14) 



(17) 
(n > 2). 



Hence, the sum value is independent of F. This is remarkable because Re H^"-* at individual 
values of u;(^'s depends strongly on F at low frequencies^' (because, e.g., electrons become 
hot by F). The sum rule implies that such strong dependence on F at low frequencies is 
always canceled completely, after integration over frequencies, by weak dependence at high 
frequencies. Regarding the asymptotic value of eq. (16), it equals the above sum value divided 
by CTjOjj. 

On the other hand, if one is interested in the kinetic energy K (to evaluate, e.g., the 'kinetic 
temperature'), then putting A = K = (l/2m) J2j iVx)'^ + {Py)'^ + {p'zf yields B^A/{ih) = 
{e/m)Y.-pi = LI, B^B^A/{ihf = (e^iVg/m)!, and B'^B^B^A = 0. These are consistent 
with the above result on a typical case, where /^ = 2, /^ = 1 in this example. The sum rule, 
eq. (14), for the n-th order response function of IS.K{t) = {K^p^j, — {K)f reads 

L{I)f {n = 1), 
integral in eq. (14) = <J e'^Ne/m (n = 2), (18) 

(n > 3). 

In this case, the sum value depends strongly on F for n = 1, whereas it is independent of F 
for n > 2. Regarding the asymptotic value of eq. (16), it equals the above sum value divided 
by (TjUj. 

These results demonstrate that whether the sum value depends on F is determined by the 
observable of interest A, the operators B^ 's which couple to f, and the order n of the response. 
We can say the same for the asymptotic values given by eq. (16). 

Concluding remarks - As discussed above, the present results hold in diverse physical 
systems, both quantum and classical, even when they are subject to dissipative environments. 
Hence, they will become foundations of nonlinear statistical mechanics and condensed-matter 
physics of NESSs, in the same way as the universal properties of $(^)'^^ are foundations in the 
linear nonequilibrium regime.^' ^' 

The present results are also important to applications because nonlinear responses are 
widely used in electrical and optical engineering.^^' "'^'^•' Since NESSs contain equilibrium states 
as the limiting case F — t- 0, <I>(")^ has greater potential than c|)(")°i. Our results show that there 
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exist fundamental limits to the spectra of ^^"-'^ even if one uses NESSs instead of equilibrium 
states. For example, as shown above, the integral of nonlinear optical susceptibilities over 
frequencies does not change by application of F, however large F is. 

Experimentally, the present results can be verified by measuring H*-")^ over a wide fre- 
quency range. One can also confirm the present results by molecular dynamics simulations, 
as was done for n = 1 in ref. 9. 

Conversely, one can use the present results to examine the correctness of results of ex- 
periments or theoretical calculations, in the same way as one uses the charge conservation to 
examine the correctness of his results. 

The author thanks T. Yuge for helpful discussions. This work was supported by KAKENHI 
No. 22540407. 
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